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REMARKS 

In the Office Action mailed December 29, 2005, the Examiner withdrew all of his 
previous rejections, finding Applicants' arguments in Amendment B persuasive. The 
Examiner rejected claims 1-10, 12, 14-17, 19-55 under 35 U.S.C. § 103(a) as unpatentable 
over the Maki reference in view of newly cited art. The Examiner allowed claims 11, 13, and 
18. 

CLAIM REJECTIONS UNDER 35 U.S.C. § 103(a) 
In section 3 of the Office Action, the Examiner rejected claims 1, 6, and 7 under 35 
U.S.C. § 103(a) as being unpatentable over U.S. Patent No. 6,072,903 to Maki et al. ("Maki") 
in view of U.S. Patent No. 4,888,703 to Baba et al. ("Baba"). Applicants respectfully 
traverse. 

Maki discloses an image processing system and method for head-tracking (following 
the movement of a head of a person), video compression capable of decreasing the data 
amount required for image communication by extracting the motion vector of the person in a 
teleconference, and three-dimensional pointing in a virtual reality system. Maki, col. 1, lines 
1 1-18. A second embodiment of the system of Maki creates a surface model of the head of a 
person. Maki, col. 14, lines 52-53. This second embodiment includes a 3-D motion 
information extraction unit that determines the position and posture of the head of the person, 
and a distance information detector that detects information on the distance to the object and 
reconstructs the shape according to the position and posture of the head. Maki, col. 15, lines 
9-16; 49-51. A third embodiment of the system of Maki obtains images of an object using a 
video camera, analyzes the images for use in three-dimensional pointing, and acquires and 
tracks the posture of the object. Maki, col. 23, line 64 - col. 24, line 11. The system of Maki 
detects the position and posture of a person's head for the purposes of creating a model of the 
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person's head or using the position and posture of the head as a three-dimensional pointer. 
Maki, col. 2, lines 47-59. 

Amended claim 1 recites "a computer configured to determine a position and shape of 
an animal from video images and to characterize activity of said animal as one of a set of 
predetermined behaviors based on an analysis of changes in said position and said shape over 
time." Maki does not teach or disclose a computer configured "to characterize activity of 
said animal" as recited in original claim 1 , nor "to characterize activity of said animal as one 
of a set of predetermined behaviors" as recited in amended claim 1 . There is no teaching or 
disclosure in Maki of using changes in the position and shape of an animal to characterize 
activity of an animal, much less characterize activity of an animal as one of a set of 
predetermined behaviors. The section of Maki cited by the Examiner (Col. 15, lines 49 - 57) 
describes the distance information detector which merely gathers distance information to use 
to reconstruct the object. Further, claim 2 of Maki (Col. 32, lines 56-67) referred to by the 
Examiner, which is dependent from claim 1 of Maki, recites additional information about the 
distance information detector for use in acquiring the shape of the object as set forth in the 
preamble of claim 1 of Maki. Thus, the shape of the object is not detected as stated by the 
Examiner, but rather it is what the system in Maki is trying to determine. The citation to col. 
24 does not supply the missing elements and merely explains that feature points are used to 
track the object over a series of images. 

The Examiner stated that Maki does not explicitly state "one of a set of predetermined 
behaviors based on an analysis of changes in position or shape," and that Baba teaches a 
processor for processing an image taken by a camera to observe the behavior of a fish and to 
produce an alarm signal when the abnormal behavior of the fish is observed, for predicting 
behavior. 
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Baba discloses an apparatus for monitoring the toxicant contamination of water by 
using aquatic animals. The Baba apparatus receives an image of the silhouette of an aquatic 
animal, such as a fish, and then calculates the position of the center of gravity of the fish 
image. Baba, col. 8, lines 24-31, 64-66. The Baba apparatus then determines the position of 
the center of gravity along a vertical axis and uses that vertical position information to 
produce a normalized distribution of frequencies versus the vertical position of the center of 
gravity. Baba, col. 9, line 24 - col. 10, line 25. This distribution is used to determine 
whether the behavior of the fish is normal. In another embodiment, the Baba apparatus 
determines the speed of the fish by calculating the rate of change of the position of the center 
of gravity of the fish. Baba, col. 10, line 45 - col. 1 1, line 49. The Baba apparatus may also 
determine the amount of movement of the fins of the fish using the same methods used to 
determine the movement of the whole fish, i.e., by using position information of the center of 
gravity. Baba, col. 14, lines 49-61. In another embodiment, the Baba apparatus detects the 
posture of the fish, again by first determining the center of gravity of the fish. The Baba 
apparatus may also reduce the image of the fish to a line to determine the angle of the fish 
image with respect to the surface of the water. Baba, col. 1 5, line 6-61 . 

All of the embodiments of Baba reduce the image of the fish to either a single point 
(center of gravity) or a single line. This one-dimensional information is then further 
processed to make a determination of whether the behavior is normal or abnormal. 

Claim 1 recites a computer configured "to characterize activity of said animal as one 
of a set of predetermined behaviors based on an analysis of changes in said position and said 
shape over time." An analysis of changes in the shape of an animal necessarily requires 
information in at least two dimensions. In Baba, the apparatus reduces the fish image to the 
center of gravity (i.e., a single point) of the fish or a single line segment, and uses this point 
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or line to determine whether the behavior of the fish is normal or abnormal. Baba does not 
teach or disclose analyzing changes in the shape of the animal over time. Tracking the 
position of a single point or single line that represents the fish does not teach an analysis of 
changes in the shape of an animal over time. A single point or a single line does not provide 
any information about the shape of an animal. In fact, Baba does not take the shape of the 
animal into account at all: "[T]he recognition of the aquatic animal is not influenced by any 
factors, such as . . . the postural change during the movement of the aquatic animal." Baba, 
col. 2, lines 56-60. Thus, Baba does not teach or disclose a computer configured "to 
characterize activity of said animal as one of a set of predetermined behaviors based on an 
analysis of changes in said position and said shape over time" as recited in claim 1 . 

Further, there is no motivation to combine Maki with Baba, and the Examiner has not 
pointed to any suggestion that one skilled in the art should combine them. Maki discloses an 
image processing system and method for head-tracking (following the movement of a head of 
a person), video compression capable of decreasing the data amount required for image 
communication by extracting the motion vector of the person in a teleconference, and three- 
dimensional pointing in a virtual reality system. Maki, col. 1, lines 11-18. Baba discloses an 
apparatus used to monitor the toxin levels in water using aquatic animals. Maki and Baba are 
directed to completely non-analogous arts. One of ordinary skill in the art of image 
processing systems would have no motivation to combine a reference relating to image 
processing systems with a reference relating to monitoring the level of toxicity of water, and 
one of ordinary skill in the art of monitoring the toxicity of water would have no motivation 
to combine a reference relating to monitoring the toxicity of water with a reference relating to 
image processing systems. It is of course impermissible hindsight reasoning to rely on the 
current application to find a motivation to combine. 
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None of the cited references, either alone or in combination, teaches or discloses all of 
the limitations of amended claim 1, and there is no motivation to combine the references. 
Applicants respectfully submit that claim 1 is not obvious in view of Maki and Baba and is 
allowable. Claims 2-7 depend, directly or indirectly, from claim 1 and are therefore 
allowable for at least the same reasons. 

Regarding claims 6 and 7, the Examiner unfortunately persists in his assertion that 
Maki discloses a biological mouse and a biological rat without explanation of his reasons for 
making such a conclusion. The portion of Maki cited by the Examiner (Col. 2 , lines 20-26) 
discloses "a three-dimensional mouse enabling movement and a pointing action in a three- 
dimensional space by the operation of the buttons on the device" (emphasis added). It is 
clear from this quotation that the mouse of Maki is a device with buttons, i.e. a computer 
mouse. Neither a biological mouse nor a biological rat is a device that enables a pointing 
action by operation of its buttons. None of the cited references teaches or discloses all of the 
limitation of claims 6 and 7, and there is no motivation to combine the references. Applicants 
respectfully submit that claims 6 and 7 are not obvious and are allowable. 

The Examiner rejected claims 2-5 under 35 U.S.C. § 103(a) as being unpatentable 
over Maki in view of Baba, and further in view of U.S. Patent No. 6,715,444 to Yabusaki et 
al. ("Yabusaki"). Applicants respectfully traverse. 

As set forth above, Maki in combination with Baba does not disclose all of the 
limitations of independent claim 1 and there is no motivation to combine the two references, 
and for those reasons alone the rejection should be withdrawn. 

Regarding claim 2 and its dependent claims, even if one were to presume that the 
combination of Maki and Baba was proper, Yabusaki does not disclose a "video digitization 
unit . . . for . . . converting said video images from analog to digital format." The portion of 
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Yabusaki cited by the Examiner (Col. 3, lines 38-54) discloses that a vibration of a cage is 
detected as an electrical signal by the displacement of a sensor, and that this electrical signal 
is detected by a frequency analyzer and converted into a digital signal. An electrical signal 
created by displacement of a vibration sensor that is converted into a digital signal does not 
teach or disclose a video digitization unit that converts video images from analog to digital 
format. Further, there in no motivation to combine Yabusaki with either Maki or Baba, as 
Yabusaki has nothing to do with processing images or determining the toxicity of water. 
None of the cited references, either alone or in combination, teaches or discloses all of the 
limitations of claim 2, and there is no motivation to combine the references. Applicants 
respectfully submit that claim 2 is not obvious and is allowable. 

Regarding claim 3 and its dependent claims, Maki does not disclose "an animal 
identification, segregation, and tracking module." The portion of Maki cited by the Examiner 
(Col. 29, lines 23-28) discloses an image calculator to determine the luminance of the feature 
points on the object. None of the cited references, either alone or in combination, teaches or 
discloses all of the limitations of claim 3, and there is no motivation to combine the 
references. Applicants respectfully submit that claim 3 is not obvious and is allowable. 

Regarding claim 4 and its dependent claims, Maki does not disclose "a behavior 
identification module for characterizing activity of said animal." The portion of the 
specification of Maki cited by the Examiner (Col. 23, lines 37-51) discloses that the three- 
dimensional position and posture of the object is determined using feature points. Claim 3 of 
Maki cited by the Examiner discloses a method of acquiring a shape of an object. Neither of 
these citations discloses the "behavior identification module" as recited in claim 4. None of 
the cited references, either alone or in combination, teaches or discloses all of the limitations 
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of claim 4, and there is no motivation to combine the references. Applicants respectfully 
submit that claim 4 is not obvious and is allowable. 

Regarding claim 5, even if one were to presume that the combination of Maki and 
Baba was proper, Maki does not disclose a "standard animal behavior storage module that 
stores information about known behavior of a predetermined standard animal." Claim 4 of 
Maki cited by the Examiner discloses a method of estimating distance information on an 
object as part of the method of acquiring a shape of an object of claim 3 of Maki. The 
portion of the specification of Maki cited by the Examiner (Col. 7, lines 19-33) discloses a 
memory for storing time-series images; a series of moving pictures. Neither of these citations 
discloses a "standard animal behavior storage module that stores information about known 
behavior of a predetermined standard animal." A series of moving pictures is not information 
about known behavior of a predetermined standard animal. None of the cited references, 
either alone or in combination, teaches or discloses all of the limitations of claim 5, and there 
is no motivation to combine the references. Applicants respectfully submit that claim 5 is not 
obvious and is allowable. 

The Examiner rejected claims 8-10, 12, 14-17, 19, and 21-55 under 35 U.S.C. § 
103(a) as being unpatentable over Maki in view of Baba and further in view of U.S. Patent 
No. 6,242,456 to Shuster et al. ("Sinister"). Applicants respectfully traverse. 

Claim 8 recites "classifying said changes in position and shape of said animal as 
postures; and characterizing activity of said animal as one of a set of predetermined behaviors 
based on a comparison of a sequence of said postures to pre-trained models or rules of said 
set of predetermined behaviors." As set forth above regarding claim 1, Maki does not 
disclose characterizing activity of an animal as one of a set of predetermined behaviors. 
Maki also does not disclose comparing a sequence of postures to pre-trained models or rules 
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of a set of predetermined behaviors. The portion of Maki cited by the Examiner (Col. 27, 
lines 20-31) discloses a comparison section that generates synthesized images and evaluates 
postures according to the similarity of the generated images to the image of the object. In 
other words, Maki teaches comparing images to determine postures, not "comparing a 
sequence of postures to pre-trained models or rules of a set of predetermined behaviors" as 
recited in claim 8. 

The Examiner stated that neither Maki nor Baba teaches classifying changes in 
position and shape of the animal as postures, but that Shuster teaches this limitation. The 
portion of Shuster cited by the Examiner (Col. 3, lines 33-62) lists various compulsive or 
stereotypical behaviors in dogs, and states that these behaviors can also be observed in other 
animals. Shuster merely provides a list of various behaviors, and does not teach or disclose 
"tracking changes" and "classifying said changes in position and shape of said animal as 
postures" as recited in claim 8. 

As set forth above, there is no motivation for combining Maki with Baba. Further, 
there is no motivation to combine Shuster with either Maki or Baba, and the Examiner has 
not pointed to any suggestion that one skilled in the art should combine them. Maki discloses 
an image processing system and method for head-tracking (following the movement of a 
head of a person), video compression capable of decreasing the data amount required for 
image communication by extracting the motion vector of the person in a teleconference, and 
three-dimensional pointing in a virtual reality system. Maki, col. 1, lines 11-18. Shuster 
discloses a method for treating a repetitive behavior disorder in animals by administering 
doses of one or more NMDA receptor antagonists. Shuster, col. 1, lines 56-61 . These two 
references are directed to completely non-analogous arts. Applicants respectfully submit that 
neither Maki nor Shuster provide any possible motivation to combine the image processing 
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system of Maki with the method of treating a disorder in animals with a certain type of drug 
of Shuster. It is of course impermissible hindsight reasoning to rely on the current 
application to find a motivation to combine. 

Baba discloses an apparatus for determining the toxicity of water. Shuster discloses a 
method for treating a repetitive behavior disorder in animals by administering doses of one or 
more NMDA receptor antagonists. These two references are directed to completely non- 
analogous arts. Applicants respectfully submit that neither Baba nor Shuster provide any 
possible motivation to combine the apparatus of Baba with the method of treating a disorder 
in animals with a certain type of drug of Shuster. It is of course impermissible hindsight 
reasoning to rely on the current application to find a motivation to combine. 

None of the cited references, either alone or in combination, teaches or discloses all of 
the limitations of claim 8, and there is no motivation to combine the references. Applicants 
respectfully submit that claim 8 is not obvious and is allowable. Claims 9, 10, 12, 14-17, and 
19-55 depend, directly or indirectly, from claim 8 and are therefore allowable for at least the 
same reasons. 

Regarding claim 9 and its dependent claims, Maki does not disclose "describing said 
sequence of said postures as behavior primitives and aggregating said behavior primitives as 
into actual behavior over a range of images." The portion of the specification of Maki cited 
by the Examiner (Col. 22, line 56 - Col. 23, line 7) discloses determining a distance image by 
executing a certain evaluation function. Claim 1 of Maki cited by the Examiner discloses a 
method for acquiring the shape of a target object. Neither determining a distance image nor 
acquiring a shape of an object teach "describing said sequence of said postures as behavior 
primitives and aggregating said behavior primitives as into actual behavior over a range of 
images" as recited in claim 9. None of the cited references, either alone or in combination, 
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teaches or discloses all of the limitations of claim 9, and there is no motivation to combine 
the references. Applicants respectfully submit that claim 9 is not obvious and is allowable. 

Regarding claim 10 and its dependent claims, Maki does not disclose "describing a set 
of conditions and rules required for characterizing said activity; and matching and testing 
generated features to see if said conditions and rules are satisfied." The portion of Maki cited 
by the Examiner (Col. 4, lines 18-27) discloses an estimation section for estimating 
information on the distance to a target object. An estimation section for estimating distance 
to a target object does not teach or disclose "describing a set of conditions and rules required 
for characterizing said activity; and matching and testing generated features to see if said 
conditions and rules are satisfied" as recited in claim 10. None of the cited references, either 
alone or in combination, teaches or discloses all of the limitations of claim 10, and there is no 
motivation to combine the references. Applicants respectfully submit that claim 10 is not 
obvious and is allowable. 

Regarding claim 12 and its dependent claims, Maki does not disclose classifying 
changes in position and shape of an animal as postures "using statistical and contour-based 
shape information." The portion of Maki cited by the Examiner (Col. 9, lines 14-27) 
discloses extracting connected feature points by finding where contours in an image intersect 
each other. Extracting connected feature points from an image does not disclose classifying 
changes in position and shape of an animal as postures "using statistical and contour-based 
shape information" as recited in claim 12. None of the cited references, either alone or in 
combination, teaches or discloses all of the elements of claim 12, and there is no motivation 
to combine the references. Applicants respectfully submit that claim 12 is not obvious and is 
allowable. 
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Regarding claim 14, Maki does not disclose classifying changes in position and shape 
of an animal as postures using "contour-based shape information selected from the group 
consisting of curvature measures, thickness measures, relative orientation measures, length 
measures, and corner points." The portion of Maki cited by the Examiner (Col. 9, lines 14- 
23) discloses extracting connected feature points by finding where contours in an image 
intersect each other. Extracting connected feature points does not teach a way of classifying 
changes in position and shape of an animal as postures as recited in claim 14. None of the 
cited references, either alone or in combination, teaches or discloses all of the limitations of 
claim 14, and there is no motivation to combine the references. Applicants respectfully 
submit that claim 14 is not obvious and is allowable. 

Regarding claims 16, 17, 19, 21, 28, 33, 39 and 48, none of the references cited by the 
Examiner correspond to the claimed limitations. 

The Examiner's grouping of claims 15, 22-27, and 29-32, and 34-38, 40-47, and 49- 
55 and rejecting them because analogous arguments apply does not enable Applicants to 
properly respond to the rejection and hence the rejection should be withdrawn. Quite clearly, 
none of the limitations of these claims are addressed by Maki or Baba, and Shuster fails to 
supply the teaching or suggestions that would render these claims obvious. 

The Examiner rejected claim 20 under § 103(a) as being unpatentable over Maki in 
view of Baba and further in view of U.S. Patent No. 5,870,138 to Smith et al. ("Smith"). 
Applicants respectfully traverse. 

As set forth above, neither Maki nor Baba, either alone or in combination, teaches or 
discloses all of the limitations of claim 8, the independent claim from which claim 20 
indirectly depends, and does not teach or disclose all of the limitations of the intervening 
claims. Thus, claim 20 is allowable. 
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Further, there is no motivation to combine Smith with either Maki or Baba, and the 
Examiner does not provide one. The portion of Smith cited by the Examiner (Col. 17, lines 
41-55) discloses a device that analyzes output of a face changer to output the probability of 
input images belonging to a specified set of expressions, and that the device may be realized 
as a Hidden Markov Model. There is no suggestion or motivation in Maki to use a Hidden 
Markov Model to output the probability of input images belonging to a specified set of 
expressions in Maki's system. Indeed, to do so would not appear to be possible and still use 
the algorithms and methods disclosed in Maki. Also, there is no motivation to combine 
Smith, a reference that discloses a device that analyzes output of a face changer, with Baba, a 
reference that discloses an apparatus used for determining the toxicity of water. 

None of the cited references, alone or in combination, teach or disclose all of the 
limitations of claim 20, and there is no motivation to combine the references. Applicants 
respectfully submit that claim 20 is not obvious and is allowable. 

To the extent that the Examiner disagrees with Applicants that the cited sections of 
the cited art do not disclose the claimed features it is requested that he explain how those 
sections relate at all to the claimed elements as opposed to merely making conclusory 
statements that they are the same. 

ALLOWED CLAIMS 
In section 4 of the Office Action, the Examiner allowed claims 11,13, and 18. 



PALOALTO 62976 (2K) 



-13- 



PATENT 
1617880-0008 

CONCLUSION 

Based on the foregoing remarks, Applicants respectfully submit that all pending 
claims in the present application are in condition for allowance and respectfully request the 
issuance of a Notice of Allowance. If a telephone conference would facilitate the prosecution 
of this application, the Examiner is invited to contact Applicants' attorney at the number 
listed below. 

Respectfully submitted, 
Yiqing Liang et al. 

Dated: ^//o/^oo ^ By: 




Wendi R. Schepler 
Reg. No. 43,091 
WHITE & CASE LLP 
3000 El Camino Real 
Five Palo Alto Square, 9 t] 
Palo Alto, CA 94306 
T. (650)213-0323 
F. (650) 213-8158 
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